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ABSTRACT 

This study shows how performance measurement can be 
developed to take advantage of the most advanced computer software 
and hardware now available. The "Toolbox" study was commissioned by 
the European Commission (EC) and undertaken by De Montfort University 
in partnership with Essex County Libraries and the Library and 
Information Statistics Unit at Loughborough University (England). 
Performance measurement systems to benefit library management should 
include mechanisms for: monitoring performance, monitoring the 
results of innovation, identifying problems and opportunities, 
evaluating alternative options, and planning. In most advanced 
countries libraries have a fully computerized catalog, an integrated 
computer system, open access, and devolved budgets. Part 1 is an 
introduction. Part 2 considers shortcomings in current performance 
indicators and proposes a general strategy to make the best use of 
present computer power. Particular attention is focused on 
calculating cost data. Part 3 outlines proposals to initiate and 
improve particular performance measures. Performance measures are 
described for analysis of staff time, speed in acquiring items and 
satisfying requests, user analysis, numbers of active users, use of 
information or reference services, space provision, stock quality 
analyzed by age and title counts, interlibrary loans and 
acquisitions, and service points and opening hours. Part 4 considers 
the applicability of these techniques to libraries of different type 
and size, particularly academic and public libraries. Figures show 
cost benefit data, request statistics, and weighted average 
calculations for bookstock. (SWC) 
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T his paper derives from research commissioned 
by the European Commission and imdertaken in 
1994 by De Montfort University in partnership with 
Essex Coimty Libraries and the Library & 
Information Statistics Unit at Loughborough 
University. Informally it was known as the Toolbox 
study. Publication of the full report of that work 
is expected in October 1995 as Library performance 
indicators and management models, Sirmsion J. 
and Ward S., Libraries in the information society 
series, Office of the European Communities, ref. 
EUR 16448EN. The findings here are reproduced 
by agreement of the EC. The very substantial con- 
tributions of colleagues to the text of this paper is 
acknowledged. 

This paper is in four parts. After the Introduction 
Part II considers shortcomings in current perfor- 
mance indicators - as revealed by the recent study - 
and proposes a general strategy to make best use of 
present computer power. Particular attention is 
drawn to the weak area of Cost: Output ratios. Part 
III outlines proposals to initiate and improve partic- 
ular performance measures. Part IV considers 
briefly the applicability of these techniques to 
libraries of different type and size. 

I. Introduction 

A lthough many libraries in Europe and through- 
out the world still operate from closed access 
stocks, the more typical situation is one of open 
access for most materials and this is the situation 
addressed here. Performance indicators are consid- 
ered in a broad context. There is not intended to be 
any particular distinction between them and the IT 
framework provided by Management Information 
Systems (MIS), Decision Support Systems (DSS) 
or later developments. Their purpose covers: 

- monitoring performance 
- monitoring the resirlts of innovation 
- identifying problems and opportunities 
- evaluation of alternative options 
- planning 



One aim of this Toolbox study is to show how per- 
formance measurement can be developed to take 
advantage of the most advanced computer software 
and hardware now available for aU but the smallest 
libraries. The project most definitely aimed to speci- 
fy to systems suppliers what should be developed 
to benefit library management. 

Having examined the extent of performance indi- 
cators in practice - and their shortcomings - the 
study then proceeded to put together a Toolbox of 
performance indicators and measures. This was 
designed both to be comprehensive and innovative. 
We aimed to include all the important indicators 
already developed, with appropriate references. 
Some new and extended indicators were added to 
meet shortcomings - and to employ latest computing 
facilities. (An example page to show the format is 
reproduced at the end of this paper.) This paper cov- 
ers only some of the most significant indicators. 

The methodology, which worked weU, was (1) liter- 
ature search and study, (2) outline draft, (3) 
consultation on this draft with expert professionals 
in several coimtries, (4) modifications and 
conclusions. 

It was known from the start that there would be 
follow-up projects, involving systems suppliers, to 
put into practice the general measures outlined. 
These are the EC projects now imder way - 
DECIDE, DECIMAL, EQLEPSE and MINSTREL. 

The place of performance indicators in the 
sequence of major development deserves mention. 

In the most advanced countries a fully computerised 
catalogue, an integrated computer system, open 
access and devolved budgets are now the rule. 
Elsewhere questions arise whether such develop- 
ments have to happen sequentially or can be imple- 
mented together. The most important development 
stages are: 

1. open access to stock 

2. material on computerised catalogue 

3. material on computerised circirlation system 

4. short loan textbook collection (academic only) 

5. acquisitions computerised 
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6. other functions computerised 

7. ‘ideal’ system with open systems and relational 
databases 

It is arguable that all these steps should be complete 
(or at least the first six) before consideration is 
given to the type of toolbox described. While 
advanced systems have existed for over six years, 
there are still many places where obsolete software 
and hardware inhibit a modem approach. 

II. Shortcomings of Traditional 
Performance Indicators 

(a) THE CURRENT SITUATION IN EUROPE 

While the impact of information technology in 
many libraries in Europe is still limited, the study 
revealed much notable woric and experimentation in 
performance measurement and decision support 
techniques. Topically there are but a few ‘pioneers’ 
in each country and sector: library managers in 
general have been slow to adapt to management 
techniques and tools widely used in other profes- 
sions. This is due inter alia to 

- ‘educational deficiencies’ in that librarians lack 
background in statistics and computing 

- ‘cultural deficiencies’ in distmst of machines 
and computer data 

- some qualitative aspects of library operation not 
susceptible to quantitative assessment 

- confusion arising from non-standard tenninology 

- most texts and manuals only available in the 
English language 

- in that many results confirm a situation already 
known to the librarian, rather than springing sur- 
prises, the effort involved may appear dispro- 
portionate 

- cumbersome presentation and lack of flexibility 
in pursuing lines of enquiry suggested by an ini- 
tial analysis 

Two levels of development are called for. The first - 
and the longest - is to raise the overall standard of 
performance measurement to that already practised 
by pre-eminent library managers. In each country, 
and between countries, there are large and crucial 
gaps between the average and the exemplary. 

The second level involves work at the leading 
edge to produce more effective and flexible systems 
by and for leading institutions. There is substantial 
scope here with the power of contemporary soft- 
ware. 



(b) SHORTFALL FEATURES 

If progress has been slow and patchy, this is due 
both to important deficiencies in the established 
methodology and also to the limitations of systems 
software and hardware in the 1980s. 

Shortcomings include: 

- Early performance measures concentrated on 
Resources and Output totals - on how well 
resources were used rather than how well users’ 
demand was met. The need to correct this per- 
spective is now acknowledged. 

- Outputs typically not related to user features. For 
example: public library in-house use can be 
analysed by age and purpose of users: academic 
library journal use by users’ status and depart- 
ment. 

- Analysis at top level only 

- Historical data not available for trends to be 
studied 

- Cumbersome nature of complete print-outs: 
inflexible or inadequate query facilities as alter- 
native 

One has only to examine these lists to see that most 
of these weaknesses can potentially be overcome. 

(c) COSTS AND PERFORMANCE 

The Toolbox differs from a number of published 
guidelines in treating cost analysis as an essential 
part of perfonnance measurement. While for many 
years this has been inherently difficult and often 
avoided, the librarians we consulted were all keen to 
see Costs included. 

The main problem can be presented quite simply. 
The obvious indicator is the Cost per Loan calculat- 
ed as Total (Net) Expenditure divided by Total 
Issues. This is extremely crude and should 
mostly be avoided - since it makes no allowance for 
the extent of non-lending use of the library. 
Increasingly this is significant where there are: 

- laige reference and information fimctions 

- services provided off the premises and through 
networks 

- well developed special services to particular 
groups of users 

- community services, educational programmes 
and exhibitions 

In broad terms there are two approaches - both in 
theory and as found in practice. 
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Solution 1 concentrates on the output measure by 
replacing ‘loan’ in the ‘Cost per loan’ formula 
with a composite measure totalling either aU the 
principal uses provided or all types of document 
delivery. 

A ‘total activity’ example from a Swedish public 
library comprises: 

Loans + Information queries + Storytelling atten- 
dances + Magazine/Newspaper reading + Visits + 
Event attendances 

Using this measure, ratios are developed for indica- 
tors such as Activities per capita, Costs per activity, 
Activities per opening hour. Activities per staff hour. 
Ratios are produced for all service points: the 
inclusion of Visits is optional. 

In UK university libraries a prototype ‘document 
delivery’ measure is made up of: 

Loans + In-librarv consultations + Inter-library 
loans + (PhotocoDies/101 + Electronic docu- 
ments delivered 

Other composite measures, some of forbidding 
complexity, have been proposed in Italy and in 
Finland. 

Such broad-bmsh formulae present a cmde but 
feasible approach. Emphasis on diverse activity can 
have publicity advantages, although the measures 
are not readily imderstandable by the public. Less 
work is involved than in Solution 2 - but the 
answers are also less satisfactory than separate . 
calculations. 

Solution 2 is the Functional Cost Analysis 
approach - where costs involved in every principal 
service are estimated to produce a separate Cost per 
loan calculation for each main service provided and 
in each main location. A matrix outline is given in 
Figure 1. 

A major feature is the analysis of staff costs 
according to staff time spent on main functions, 
such as: 

- Lending & circulation (adult/children’s 

combined or separate) 

- Mobiles 

- Information & reference 

- Domiciliary service 

- Specialist services, eg. archives, local studies 

- Promotion 

- Study spaces 

- User training , & instruction 

- Acquisitions (Incl. Cataloguing) 

- Regular children’s activities 

- Special events 

- Preservation 

1 



It should not be necessary to install sophisticated or 
extra time clocking procedures. AimuaUy each 
member of staff apportions the percentage of time 
spent on principal functions - this to be checked and 
agreed by management. (Percentages have the huge 
advantage that they must, by definition, come to 
‘100’!) These percentages are then applied to armual 
staff cost figures and adjusted by an allowance for 
indirect and overhead charges. Management func- 
tions such as personnel and finance, are allocated to 
service functions in proportion to staff time or staff 
expenditure. In this way is derived a staff and 
management cost estimate for each main function 
on each site/service point. 

This point is discussed succinctly in Keys to suc- 
cess, p.87 (King, 1990). That publication has a 
valuable summary of cost calculations (pp. 87-92): 

‘There are three ways to measure staff time: 

- use time sheets continuously or periodically 
throughout the year. 

- observe staff on a random basis to determine the 
proportion of time spent on specific activities, 
services or functions. 

- ask staff or their supervisors to estimate the pro- 
portion of time spent on specific activities, ser- 
vices or functions throughout a year. 

Interestingly, the three ways of allocating staff 

time to services do not yield greatly different 

results.’ 

It is more straightforward to allocate other costs . 
Materials are conventionally charged to adult 
lending, adult reference, children’s audio/visual, etc. 
and/or analysed as books, periodicals, CD-ROMs, 
music, maps, audio/visual, etc. Premises costs are 
allocated according to space used for different func- 
tions. Automation and other costs are allocated as 
appropriate - typically in proportion either to space 
of staff time employed on each function. 

The results of this approach are Cost: Output 
ratios which are more exact and meaningful than 
any large composite measure can be. These superior 
measures apply to both the cost and output mea- 
sures and indicators. In a large library they are vital 
for informed allocation of resources and to inform 
decisions on service expansion. Obviously a special 
or college library employing two to five staff does 
not need such management data to the same level as 
a university library system employing 200-500. But 
in mote complex organisations - particularly where 
convergence brings new or blurred dividing lines - 
such disaggregation of cost measures are specially 
important. 
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Why has this not happened already? In the past 
inhibiting factors include: 

1. no help with detailed procedures and inadequate 
definitions 

2. no obyious application to the most pressing prob- 
lems 



er|c 



3. no requirement formulated for systems work 



4. lack of appropriate computer hardware and soft- 
ware 

5. fear of accountancy precision requirement 

The fourth factor should be oyercome by modem 
relational database software on platforms now with- 
in a general price range. The fifth factor has been 
coyered aboye: it is essential not to confuse this sys- 
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tem with that required to monitor and control 
expenditure. The first three factors are - in effect - 
the subject of this study: there are many decision 
areas where managers are currently navigating in 
the financial shadows. 

The diagram in Figure 1 shows what issues are 
involved, and the complexities that wUl arise in 
local implementation. 

Large organisations need to estimate costs in four 
dimensions: 

1. by type of expenditure: staff, materials, premis- 
es, automation (income), etc. 

2. by location: site, service point, information unit 

3. by function: adult lending, children’s lending, 
information, storytelling, events, reading 
places, etc. 

4. by subject category and, for some purposes, 
academic department 

The requirement is not to provide extensive weekly 
or monthly reports covering all levels of measure 
and indicator. The requirement is to provide facili- 
ties for cost:output calculations, or cost allocation 
ratios, on an enquiry basis as and when these are 
required to support particular investigations for 
decision steps. For this puipose data need to be 
readily accessible and conveniently manipulated for 
special reports and for ad hoc enquiries. 

(d) HARNESSING COMPUTER POWER TO 
OVERCOME SHORTCOMINGS 

In principle what is required is the ability to access 
datasets, in convenient enquiry mode, on a much 
larger scale than has hitherto been envisaged. It 
should now be within the capacity of the present 
generation of computer hardware and software to 
provide what is required. The models - and 
indicators to the level of analysis proposed - can not 
be said to be ‘tried and tested’ in practice. Most 
elements have been in operation in some places. 
Some items in the Toolbox therefore require feasi- 
bility study and development. 

This proposal derives from the expressed needs 
of library managers - and from the logic of the 
situation. It is not a case of putting new technology 
to use because it is there, but rather that technology 
will now permit what has been a requirement for 
decades. It is in line with the reasoning in the draft 
IFLA Report Afea^Mn'ng quality (pp.11-14). It also 
represents a culmination of current developments in 
France (Tableau de bord), Sweden (Kristianstad), 
Denmark (Copenhagen Business School), Germany 
(Betriebsvergleich project), and Italy (composite 



indicator). In aU these instances librarians have been 
deriving valuable cost:output ratios, but have been 
imable as yet to come to an overall generalised solu- 
tion. 

The library manager needs to be empowered, not 
inhibited or impoverished. This is the strategic 
approach that imderlies the irmovative aspects of the 
Toolbox. Working this out represents a major 
change in approach. Generally systems analysts aim 
to hold and present only data which is specifically 
known to be in demand. The proposal here is for 
data to be held whenever it might be required - 
often in several years’ time. 

In this concept data are entered and held with 
regard to their ultimate not their immediate use. For 
example to hold date of birth, date of registration 
and post code area will allow not only correct 
calculation of fines and privileges but also analyses 
of lapsed users and comparisons of users: age/sex 
profile with residents in areas served. Studies can be 
made of library use by students by year and by 
faculty/department - compared with previous years’ 
experience. 

(e) THE MULTI-DIMENSIONAL DATABASE FOR 

ENQUIRY INTERROGATION 

The data required comes from automated library 
systems, external database sources, and from manu- 
al sources. The purpose of this database (or linked 
databases) is to allow easier and more effective use 
of established performance indicators as well as 
more sophisticated features that include: 

- functionally analysed expenditure/costs 

- several years data held and analysed 

- separate units within the library 

- separate analyses according to subject 

disciplines 

- ‘real’ data corrected for inflation indexes 

- quantitative measurement of electronic services 

The amoimt of data to be held - by modem industry 
standards - is not large. However the organisation 
of such data is a major undertaking relying entirely 
on Relational database and SQL software. 
Procedures to maintain a readily accessible histori- 
cal data file, and to relate this to the next year or 
two, need to be worked out and maintained with 
care and adequate documentation. A main objective 
must be to make the data collection process as easy 
as possible for the librarian, that is, requiring mini- 
mum effort and resources. 
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(f) LOWER LEVEL ANALYSIS 

The need for this is paramount. Examples of what 
is required include the following; 

Library users: - breakdown by type of user 

or other attributes 

- user education hours 

Staff: - breakdown by job, function 

or task 

Library facilities; - equipment breakdown by 
type 

- shelving calculation accord- 
ing to open and closed 
access 

Library collection: - materials spend - breakdown 
by type of material or 
subject categories 

- spending on conservation 

- periodicals - paid/new/ 
cancelled subscriptions 

Library use: - remote use - defined accord- 

ing to telephone, fax, elec- 
tronic mail etc. 

- in-library use - breakdown 
by material type eg. periodi- 
cals, reference 

- materials; by facility eg. CD- 
ROM, photocopiers 

- number of issues - break- 
down by loan, renewal and 
reservation, time of day 

- attendance at in-house activi- 
ties eg. storyteUing sessions 

(g) DATA FOR OTHER YEARS 

To establish trends data need to be held for recent 
years. Practitioners feel this is important. However 
in existing computer systems there have been severe 
feasibibty problems in holding and accessing 
historical data - in terms of the hardware and soft- 
ware employed in stand-alone systems. Neither has 
such a demand been clearly enunciated. 

For some features aggregated data should also be 
available for the preceding ten years. As can be seen 
from Figure 1, the amount of data conceptually 
required for such a database is very large - and it 
is not feasible for traditional ‘MIS type’ reports or 
spreadsheets. 

This need is recognised and extended in the 
‘tableau de bord’. 
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‘The “tableau de bord” does not have the same 
role as the statistical enquiry. It is not limited to 
establishing what has happened: it is an instru- 
ment for forecasting and navigating - essential to 
the local plan . . . The “tableau de bord” by way of 
elaborating these decisions has also a retrospec- 
tive effect thanks to a regular monitoring of 
results. Decision makers can then correct or adjust 
(in good time) the actual events, and effectively 
reformulate the paths chosen, the objectives and 
action plans.’ 

So is added the immediate future and the planning/ 
budgeting dimension. 

How long is ‘the recent past’? Practitioners consult- 
ed in the course of our study focused on the last 
ten years rather than the last five. On this database 
the ‘future’ should at least cover the budget for the 
present year and a forecast for the year following. 
Beyond that lies strategic or medium/long-term 
planning, which will have important coimections 
between this database with its performance indica- 
tors and such longer-term plans. 

For how many indicators and measures should 
historic data be held? This is not easy to decide, but 
the following guidelines should be helpful; 

- there is no need to hold more than annual results: 
data for intermediate periods will not be 
required 

- detailed analysis needs to be held either in per- 
centage form Or in absolute numbers, not both 

- at least the first level of breakdown will be 
required for expenditure, materials, subject cate- 
gories, user categories etc. 

- whether to hold data for each site or for the 
whole library system will depend on the size 
and structure of the library authority. For all but 
the smallest units, it will normally be valuable 
to hold data separately for the central library and 
for the whole system. Much data should also be 
held for each service point. 

- since organisational arrangements and provision 
of buildings and technological features change 
unpredictably over time, the holding of disag- 
gregated data is to be encouraged. 

Sights need to be set beyond the circumstances of 
the present scene to the xmcertain future. As already 
propounded above, here it is not appropriate to fol- 
low the limiting maxim that ‘data should only be 
collected and held where there is a demonstrable 
need’. 
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III. Particular Proposals 



(For all items in this section measures can be used 
as such or converted to give ‘per capita’ ratios of 
performance.) 



Ill (a) ANALYSIS OF STAFF TIME 

As discussed above, this is to provide data (1) for 
monitoring, review and decisions on optimum 
allocation of staff time; (2) to publicise to outsiders 
the variety of tasks undertaken; and (3) to calculate 
costrbenefit (costroutput) ratios. 

The categories for analysis will vary according to 
local circumstances. The lists that follow indicate 
likely minimum or cone requirements and a longer 
list of further options: 



Core Categories 

Lending & Circulation 
Reference/Information 
Acquisitions/Cataloguing 
Training Users 
Automation 
Management 
Promotion/Special Events 
Miscellaneous 



Further Options 

Children’s/Adult work 
Mobile Service 
Specialist services, eg. 
Archives 
Local Studies 
Business 

Domiciliary Service 
Conservation / 
Preservation 



III (b) SPEED OF SUPPLY/REACTION BY RETRa 
SPECTIVE SAMPLING 

Measuring this is properly done by sampling. 
However it is not everywhere realised that there are 
advantages in taking the sample at the end of the 
process rather than identifying sample items at the 
start. QericaUy much less work is involved; it is 
also less susceptible to manipulation in that staff do 
not have the opportunity to give preferential treat- 
ment to items earmarked as part of a sample. In 
presenting average results the ‘median’ is preferred 
to the ‘arithmetic mean’. This technique only takes 
account of items that have been supplied, so the 
number or proportion of failed actions has to be a 
separate measure. 

We give here examples to illustrate the technique 
rather than a comprehensive set of applications. 

To determine the time taken to acquire items and 
to make them available to users the following steps 
are undertaken: 

1. Take a sample of items that are newly available 
on the shelves. 

2. Obtain data on the date each item was ordered by 
the library. 

3. Subtract the order date (or publication date where 
books were ordered prior to publication) from the 
current date. 



4. Calculate the median number of days taken for aU 

items in the sample - or the proportion of items 

made available within n days. 

For more detailed analysis each individual stage 
through ordering, checking, cataloguing and pro- 
cessing can be analysed separately, if data is collect- 
ed at each point. This is an important measure to 
identify bottlenecks and delays at different stages in 
the supply process. 

This sampling technique should also be applied to 
the overall speed in satisfying requests - the 
time taken to satisfy aU types of request for material 
not immediately available on site. This covers time 
taken for delivery of material to be supplied through 
acquisition, interlibrary loan, fetching from other 
sites/service points, and material recalled where it is 
already on loan. Each of these is also an indicator in 
its own right. (Note the Essex ‘success stories’, 
illustrated in Figure 2, where one graph shows both 
increased use, shorter throughput times, and the 
trends over recent years.) 

From a selection of satisfied requests the time is 
taken from the original request date to the date the 
user is notified of availability. The indicator is the 
average (the median, not the arithmetic mean) of 
these results. 

Ill (c) (1) USER ANALYSIS BY TYPE OF USER 

Categorisation of users wiU often be demanded for 
these measures. In academic libraries this wtU 
typically be by faculty/department and by status, in 
public libraries by age, sex, status and residence - 
such as: 

- undergraduate students 

- postgraduate students 

- academic staff 

- external visitors 

- others 



III (c) (2) ACTIVE USERS 

To determine the number of active borrowers (those 
who have had at least one item issued to them in the 
last 12 months) is possible with most automated cir- 
culation systems. If the system, or a significant part 
of it, is not automated, this can be difficult or 
impossible. But to limit the count to borrowers is 
not ideal, so there are ways to extend this to aU 
active users . 

To establish the proportion of the population 
using the library we need to know the number of 
people from the target population who have used 
the library during the last year. This can be obtained 
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- children 

- young adults 

- adults 

- pensioners 

- non-residents 

- unemployed 

- disabled 
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Figure 2 

Annex B: Es^x Libraries - Request Statistics 1989/M • 1994/95 
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by one of two methods: either (1) In a survey of the 
target population, people are asked whether or not 
they have used the library during the last year; or 
(2) Establish from a questionnaire survey the pro- 
portion of users who never borrow material and 
apply this percentage to the number of active bor- 
rowers. 

Example: A users’ survey establishes that 14% of 
users have not borrowed material in the previous 
12 months. The number of borrowers who have 
taken out at least one book or A/V item in the pre- 
vious 12 months from that service point is 12,260. 
The number of active library users is therefore: 



(1-0.14 = 0.86) 

III (d) USE OF INFORMATION SERVICES 

Counting the number of Reference Transactions 
handled is not without its problems. It is difficult 
to achieve consistency when transactions are count- 
ed by library staff either on a sample or an ongoing 
basis. However, a major drawback is that success in 
getting users to help themselves to information - by 



well signposted stock, for instance, has a negative 
effect of the Transaction count. 

To overcome this weakness a modification to the 
ALA Needs Fill Rate questions is proposed by 
including a question: 



If you were looking for information (ie. to find 
something out) were you successful? 

YES / NO / PARTIALLY 

Did you consult a member of staff? YES / NO 

The results assess (1) the success of users in obtain- 
ing information on their own, (2) their success in 
queries addressed to staff, and (3) the proportion of 
users requiring information. The data relate to 
specific needs on a particular day, and they rely on 
the users’ immediate assessment of satisfaction. 

Ill (e) SPACE PROVIDED 

This can be categorised according to purpose: 

(i) ‘ Library Services’ includes space used for read- 
ing, studying, information delivery, computers 
and any other services delivered to users by 
library staff. 
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(ii) Library operations includes receipt of materials, 
bindery, acquisitions, cataloguing, computing, 
and management. 

(iii) Materials storage includes aU areas principally 
devoted to materials whether open access, closed 
access, special collections or reserve stock. 

(iv) Special events’ includes seminar and meeting 
rooms, space for groups to meet, and exhibition 
space. 

(v) Miscellaneous includes caf 6 s, toilets and staff 
recreation areas. 

(vi) Access measures space required only for access 
to other areas, ie. corridors and gangways. 

(v) and (vi) need not be separated; in small 
libraries categories (i), (ii) and (iii) will be suffi- 
cient. 

Measurement of space is useful to review allocation 
of the space provision and to establish or avoid the 
need for new building. A further analysis by princi- 
pal services delivered will also be valuable in many 
situations, eg. space taken up by special collections, 
local history, special information services, etc. 
Factors for the allocation of premises costs to par- 
ticular services and/or functions can be established. 

Measurement of floor areas can often be taken 
from data used for other purposes, eg. cleaning 
contracts, insurance quotations. Space measure- 
ments should be checked for an annual review, but 
there is no need for frequent recalculation. Precision 
in the allocation of space between categories is not 
essential. 

This measure should not include space occupied 
by theatres, museums, concert haUs where these are 
not used for ‘library’ purposes but may be physical- 
ly on the same premises. Space for reserve stock is 
included in (iii). 

Ill |f) STOCK QUALITY ANALYSED BY AGE AND BY 
TITLE COUNTS 

The Age of items in stock is a simple calculation 
showing the proportion of stock more than n, 
nj, nj, 114 .... n, years old. Items are counted rela- 
tive to year of acquisition or year of publication. 
Generally the date of acquisition is preferred - since 
an old book acquired during stock revision will 
clearly be still popular at the date of acquisition. 

Example: 



O 

ERIC 



Bookstock 


0-5 years old 


61% 


tt 


6-10 years old 


12 % 


tt 


11-15 years old 


4% 


tt 


16-20 years old 


3% 


tt 


21 + years old 


20 % 



There is more scope for Title counts in sets of per- 
formance indicators than is indicated in recent 
literature. To assess the staleness/appropriateness of 
stock a count of titles that have issued during 
the year (or quarter) can be compared with the num- 
ber that have stayed on the shelves. This can be 
particularly revealing for separate sections of stock, 
although it does not, of course, cover use on the 
premises. 

Titles added per capita. Copies added per title 
added, and Titles issued per capita are aU indicators 
revealing the extent to which multiple copies of 
best-seUers conflict with objectives of stock variety 
and depth of interest. These are of particular interest 
to large public library authorities needing to balance 
decisions in the ‘popular materials’ interest of par- 
ticular service points as against the breadth required 
in the overall collection of the authority. 

Ill (g) INTER LIBRARY LOANS v. ACQUISITION 

Cost and performance data for demand satisfied 
through Interlibrary Loans are required to compare 
with costs of acquisition and holding. Measurable 
costs include payments for staff time, storage space, 
overheads, notifications and subscriptions as well as 
direct payments for material bought in. Measurable 
performance covers speed of supply. Some impor- 
tant unmeasurable factors are also relevant. 

Ill (h) SERVICE POINTS AND OPENING HOURS 

Service points that open for only a few hours each 
week, and small informal collections of material, 
can be excluded from the coimt where there is a 
minimum qualification, for example: ‘Service 
points open 10 hours/week and more’. Another 
method to assess differences is to tabulate the count: 

Example: 



Service Points open 45 hour/week and more 
Service Points open 30-44 hours/week 
Service Points Open 20-29 hours/week 
Service Points open 10-19 hours/week 
Mobiles 



2 

4 

7 

1 

2 



16 



Service Points open less than 10 hours/week 5 

Homes, hospitals, etc. served 18 22 

As a base for performance measures these totals are 
of limited value. 

Multiplying Service Points by Hours Open (to 
give Service point hours open! is some improve- 
ment, but it only gives an accurate reflection of the 
level of service where (i) there is a single service 
point in the authority/institution, (ii) where aU ser- 
vice points open for the same number of hours each 
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Figure 3 
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week, or (iii) where the subsidiary service points 
are not significant and can be ignored. Total service 
point hours can give a very misleading picture 
where there are multiple service points open for a 
different number of hours per week. 

To overcome these problems a new measure is 
proposed: 

Weighted average hours open per week 

Definition : Average hours per week library services 
are available. A weighting factor relating to the size 
or use of service points is used in calculating the 
average. 

Method : Opening hours for each service point are 
weighted according to the size/use of that service 
point to produce an average figure. Weighting factor 
can be either Issues, Floor Space, Staff numbers. 
Stock, items On Loan, Readers’ Seats or Visits - 
whichever is most appropriate or critical. For public 
libraries Issues or items On Loan will be favoured. 
For academic libraries it may well be Readers’ 

Seats (student bias) or Stock (research bias). 

F.xamnle : For the purpose of illustration we choose 
Bookstock for the weighted average calculation, 
which then gives these results for 1993 and 1994 
{Figure 3). 

This measure refers to hours services are physi- 
cally available to users on library premises. 
Distinction can be made between (a) full services, 
and (b) partial services. In academic libraries sepa- 
rate counts are needed for term time and vacations. 

IV. Differences between Types of 
Library 

D uring our consultations surprise was fiequently 
expressed that we were covering, in one study, 
both academic and public libraries . The tradition in 

O 

ERLC 



the literature of performance indicators is for 
separate treatment. We believe it was good to have 
the combined approach - partly because computer 
systems generally have to cater for aU types. 
However this does mean that the Toolbox must be 
viewed sensitively. Many of the indicators and pro- 
posals will apply to some types of library only. 

Some of the most significant variations are these: 

- large university library with central and depart- 
mental libraries on several sites 

- university library on one central site 

- special libraries employing 2-5 staff with heavy 
online information load 

- large public library authority employing hun- 
dreds of staff in 30-80 service points grouped in 
areas 

- substantial public library authority with large 
central library and several branch service points 

- city public library 

- small town public library 

The principles underlying the Toolbox can apply to 
aU these situations, but the appropriateness of 
particular indicators will vary greatly. 

School libraries were not considered as part of 
this project; special libraries and college libraries 
have received less consideration than university and 
public libraries. National libraries or regional co- 
operatives were not covered. 

Even more important is the question of size . 

There are substantial variations between large and 
small library authorities. The Toolbox is constracted 
to cater for the largest. Qearly there are many items 
that will not be appropriate for smaller organisa- 
tions, and this needs to be borne in mind through- 
out. 
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Conclusions 

I n practice local and national definitions will be 
required. It was not an objective of this study to 
standardise detail - but rather to outline information 
requirements for future computer systems develop- 
ment . This woik is being undertaken in the four suc- 
cessor projects of the European Commission - 
DECIDE, DECIMAL, EQLIPSE, and MINSTREL - 
for which this Toolbox study is a base. 

There is also the obvious need to extend perfor- 
mance measures to the software and networks that 
handle electronic journals and new media. This ah 
represents an ambitious work programme! 
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Example page from the Toolbox Study to be published October 1995 by Office of the European 
Communities in series ‘Libraries in the information society’ ref. EUR 16448 EN. 

Title: Library Performance Indicators & Library Management Models. Authors: Sumsion, J. and Ward, S. 



J.22 Number of Items of equipment In the library per capita 

Method: The number of items of equipment (e.g. CD-ROM access points, OPAC terminals, PCs, 
photocopiers) available to users in the library, divided by the target population [This can be 
expressed per 1,000 or per 100 or inverted]. Each category should be calculated separately. 

Interpretation: Indicates the level of provision. Use and user satisfaction should also be considered. 

J.23 Seat Occupancy , ^ * 

Definition: The ratio of occupied seats to the total number of readers seats. 

Aim: To indicate the extent to which seating is occupied as an indication of availability of seats for 
users. 

Scope: The indicator is suitable for types of library offering facilities for study and reading. It can 
be applied to separate areas of the library. 

Method: At predetermined time intervals count the number of seats occupied and divide by the 
total seats available. This can be done in two ways: 

(a) Peak To determine an occupancy rate when pressure is greatest, for example in an academic 
library at 1100, 1200, 1400 and 1500 hours during the busiest weeks of term. 

(b) Average Sample at hourly intervals during typical weeks three or four times a year (in 
academic libraries: mid-term weeks). 

Interpretation: A high occupancy rate may point to inadequate seating for users. . 

Factors affecting the Indicator Weather, time of year, timing of examinations and vacations. 



J.24 Facilities use rate , r • * 

Definition: The proportion of time a library facility (e.g. a seminar room) or an item of equipment 

is busy. 



Method: Equipment and facilities are observed at sample times to determine whether or not they 
are being used. Every person using, or waiting to use the equipment or facility is counted, and the 
total is divided by the number of that type of equipment or facility. (See Measuring Academic 
Library Performance pp82-88 for detailed description.) 



* J.31 Users’ satisfaction with library facilities 

Definition: Users’ rating of their satisfaction with library facilities, e.g. readers’ seats, CD-ROM, 
OPAC, computers, photocopiers. (Ratings for each should be collected and analysed separately.) 

Method- In a questionnaire-based survey, users of the reference service are asked to rate their 
satisfaction with the particular facility. Questionnaires frequently use a five-point scale, ranging 
from 1 for "not satisfied" to 5 for "very satisfied". 



More detailed analysis: 

1. Users could also be asked to rate the importance (to them) 



of the particular facility. 
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